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Abstract 

,-— I In this paper, we study nonzero-sum separable games, which are continuous games 

1 ^ whose payoffs take a sum-of-products form. Included in this subclass are all finite 

games and polynomial games. We investigate the structure of equilibria in separable 
(NJ games. We show that these games admit finitely supported Nash equilibria. Motivated 

by the bounds on the supports of mixed equilibria in two-player finite games in terms 

^ of the ranks of the payoff matrices, we define the notion of the rank of an n-player 

continuous game and use this to provide bounds on the cardinality of the support of 
^ equilibrium strategies. We present a general characterization theorem that states that 

O a continuous game has finite rank if and only if it is separable. Using our rank results, 

we present an efficient algorithm for computing approximate equilibria of two-player 
separable games with fixed strategy spaces in time polynomial in the rank of the game. 

> 
(N 

^ 1 Introduction 
rn 

^ The structure and computation of equilibria in games with infinite strategy spaces have long 

been recognized as complex. Even seemingly "good" games may possess only "bad" equi- 

O libria; Gross has constructed an example of a zero-sum game with rational utility functions 

>■ whose unique Nash equilibrium is for each player to play the Cantor measure fHX [TB] . To 

^ avoid such pathologies, Dresher, Karlin, and Shapley introduced the class of zero-sum sep- 

^ arable games [HI El [lH [13]. These are games in which each player's payoff can be written 

as a sum of products of functions in each player's strategy separately (e.g. as polynomials), 
and it is known that every separable game admits a mixed strategy Nash equilibrium that is 
finitely supported, i.e. all players randomize over a finite number of pure strategies. Parrilo 
has shown that Nash equilibria of zero-sum games with polynomial utility functions can be 
computed efficiently [T9] . 
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In this paper, we study nonzero-sum separable games. We show that even in the nonzero- 
sum case, separable games have the property that an equilibrium exists in finitely supported 
mixed strategies. We then characterize the structure of these games and their Nash equilibria, 
and also propose methods for computing (exact and approximate) equilibria. 

Our first major contribution is to define and develop the concept of the rank of a con- 
tinuous game, which we use to construct bounds on the number of strategies played in 
equilibrium. In two-player finite games, Lipton et al. have recently shown that the ranks of 
the payoff matrices provide such a bound [16]. Our new definition of rank generalizes this 
one to allow for an arbitrary finite number of players (a problem explicitly left open in [16j) 
and infinite strategy spaces. We define the rank of a continuous game by introducing an 
equivalence relation between mixed strategies called almost payoff equivalence. The rank is 
the dimension of the mixed strategy space modulo this equivalence relation. Loosely speak- 
ing, low-rank continuous games are those where the variation in each player's payoff depends 
only on a low-dimensional projection of the mixed strategies of the players. For example in 
games with polynomial payoffs, the rank depends on the dimension of a projection of the 
moment space. 

We also show that a continuous game has finite rank if and only if it is separable. This 
means that little can be said about the structure of equilibria in non-separable continuous 
games and highlights the importance of separable games. We provide simple techniques 
for evaluating the rank of separable games, which we specialize to games with polynomial 
payoffs and finite games. 

Our second set of results concern efficient computation of mixed strategy equilibria in 
separable games. For n-player games, we provide a nonlinear optimization formulation, and 
show that the optimal solutions of this problem correspond to the (generalized) moments 
of exact Nash equilibria. This formulation generalizes the optimization formulation of Nash 
equilibria of finite games presented by Ba§ar and Olsder 

While the nonlinear optimization formulation for the computation of equilibria is tractable 
for certain classes of separable games such as zero-sum polynomial games, the potential non- 
convexity of the optimization problem makes it impractical in other cases. We therefore 
supplement our computational results for exact mixed strategy equilibria with new meth- 
ods for computing approximate mixed strategy equilibria. Using our rank results described 
above, we can link the computation of mixed strategy equilibria to the appropriate dis- 
cretization of the strategy space into finite actions. For two-person separable games, this 
yields an efficient algorithm for computing approximate mixed strategy equilibria in time 
polynomial in the rank of the game. This algorithm searches for finitely supported approxi- 
mate equilibria by enumerating all possible supports, and relies on the fact that the search 
can be limited to supports of size bounded by the rank of the game. For two-players, the set 
of equilibria for a given support can be described by linear equations and inequalities 

Our work is related to a number of literatures. There has been considerable work on 
the computation of equilibria in finite games. Lemke and Howson give a path-following al- 

^With more than two players this description is no longer linear (or convex), so this algorithm does not 
generalize to n-player games with n > 2. 



2 



gorithm for two-player finite games which can be viewed as the simplex method for linear 
programming operating with a different pivoting rule [15]. To find equilibria of games with 
more players, Scarf constructs a simplicial subdivision algorithm which also works for more 
general fixed point problems [22]. These methods rely on the polyhedral structure of the 
mixed strategy spaces of finite games, therefore they seem unlikely to generalize to contin- 
uous/separable games. For a survey of algorithms which compute equilibria of finite games, 
see [I7|. 

Another growing literature has been investigating the complexity of computing mixed 
strategy Nash equilibria of finite games. Daskalakis, Goldberg, and Papadimitriou settle this 
question for finite normal form games with four or more players, showing that the problem of 
computing a single Nash equilibrium is PPAD-complete [H]. In essence this means that it is 
computationally equivalent to a number of other fixed point problems which are believed to 
be computationally difficult. These problems share the feature that a solution can be proven 
to exist, but the known proofs of existence are inefficient; for more about the complexity class 
PPAD, see [18]. Daskalakis and Papadimitriou later improve this result by proving PPAD- 
completeness in the case of three players [7]. Chen and Deng also prove this independently 
[1] and complete this line of work by proving PPAD-completeness for two players [5] . In this 
literature, there has been no work on continuous games. 

Our work is most closely related to the work of Lipton et al. [16], who consider two- 
player finite games and provide bounds on the support of equilibrium strategies using the 
ranks of the payoff matrices of the players. Since finite games are a special case of separable 
games, our results on the cardinality of the support of equilibrium strategies generalize theirs 
by allowing for an arbitrary finite number of players as well as infinite strategy sets and a 
broader class of payoff functions. 

Lipton et al. also investigate computing approximate equilibria in two-player finite games 
and present the first algorithm for computing approximate equilibria which is quasi-polynomial 
in the number of strategies [TB]. The rank of a separable game measures the complexity of 
the payoffs, and in the case of a finite game it is bounded by the number of strategies. 
Therefore in finite games the complexity of the payoffs and the complexity of the strategy 
spaces do not vary independently; the effects of these parameters on the running time of 
algorithms cannot be distinguished. However, for games with infinite strategy sets the rank 
can be varied arbitrarily while the strategy set is held fixed. This allows us to construct 
an algorithm for computing approximate equilibria in two-player separable games with fixed 
(infinite) strategy spaces and show that it has a polynomial dependence on the rank. Since 
we assume the strategy space is fixed and consider general separable games rather than only 
finite games, our algorithm is not directly comparable to that of Lipton et al. [16]. Nonethe- 
less it is interesting on its own since no algorithm for computing approximate equilibria of 
finite games is known which has polynomial dependence on the complexity of the game. 

Our work is also related to that of Kannan and Theobald, who study a different notion of 
rank in two-player finite games [l2] . They take an algorithmic perspective and view zero-sum 
games as the simplest type of games. To generalize these, they propose a hierarchy of classes 
of two-player finite games in which the rank of the sum R+C of the payoff matrices is bounded 
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by a constant k; the case k = corresponds to zero-sum games. For fixed k, they show that 
approximate Nash equilibria of two-player finite games can be computed in time polynomial 
in the description length for the game. This algorithm relies on an approximation result 
for quadratic programming due to Vavasis ^Sj which depends on the polyhedral structure 
of the problem. It is conceivable that this technique may apply to polynomial games if the 
approximation technique can be extended to this more general algebraic setting, but we do 
not do so here. 

The rest of this paper is organized as follows. In Section [2] we define separable games and 
prove some of their basic properties. Then in Section [3] we define the rank of a continuous 
game and use this definition to bound the cardinality of the support of Nash equilibria. 
We present a characterization theorem for separable games which in particular shows that 
within the class of continuous games, the low-rank results in this paper cannot be extended 
past separable games. We provide a simple formula for computing the rank of arbitrary 
separable games, which we specialize for finite and polynomial games. In Section |4] we discuss 
computation of Nash equilibria and approximate equilibria. We close with conclusions and 
directions for future work. 

2 Basic Theory of Separable Games 

We first introduce the notational conventions and the basic terminology used throughout the 
paper. Subscripts refer to players, while superscripts are reserved for other indices, rather 
than exponents. If Sj are sets for j = 1, . . . ,ra then S = U^^^Sj and S'_j = Uj^iSj. The 
n-tuple s and the (n — l)-tuple s_j are formed from the points sj similarly. Given a subset 
S of a vector space, we use the notation span S, aff S, conv S, and S to denote the span, 
affine hull, convex hull, and closure of the set S, respectively. We denote the transpose of a 
matrix M by M'. 

Definition 2.1. An n-player continuous game consists of a pure strategy space Ci 
which is a nonempty compact metric space and a continuous utility or payoff function 
Mj : C — >■ M for each player i = 1, . . . ,n. Throughout, Aj will denote the space of Borel 
probability measures at over Ci, referred to as mixed strategies, and the Ui will be extended 
from C to A by expectation, defining 



where the n-tuple a = (ai, . . . , (T„) is identified with the product measure ui x • • • x an- 

Definition 2.2. An n-player separable game is an n-player continuous game with utility 
functions : C — M taking the form 
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where aj^'"-'" G M and the // : Cj — M are continuous. Two important special cases are 
the finite games in which the Cj are finite and the Ui are arbitrary and the polynomial 
games in which the Ci are compact intervals in M and the Ui are polynomials in the Sj. 

When it is convenient to do so, and always for polynomial games, we will begin the 
summations in ([T| at jj = 0. For polynomial games we can then use the convention that 
fl{si) = s^l, where the superscript on the right hand side denotes an exponent rather than 
an index. 

Example 2.3. Consider a two player game with Ci = C2 = [—1, 1] C M. Letting x and y 
denote the pure strategies of players 1 and 2, respectively, we define the utility functions 

ui{x, y) = 2xy + 3y^ — 2x^ — x — 3x'^y'^ and 
U2{x, y) = 2x^y'^ — Ay^ — x^ + Ay + x^y. 

This is a polynomial game, and we will return to it periodically to apply the results presented. 
In particular, we will show using classical techniques that this game must have a Nash 
equilibrium in which each player randomizes over a set of cardinality at most 5. We will 



then apply our new rank results (see Theorem 3.3) to reduce this bound to 2 for the first 
player and 4 for the second player. 

Let Vi denote the space of all finite-valued signed measures (henceforth simply called 
measures) on Cj, which can be identified with the dual of the Banach space C(Cj) of all 
continuous real- valued functions on Ci endowed with the sup norm. Throughout, we will use 
the weak* topology on Kj, which is the weakest topology such that whenever / : Cj ^ M is 
a continuous function, c ^ J fda is a continuous linear functional on Vi. 

We can extend the utility functions of a continuous game to all of V in the same way they 
are extended from C to A, yielding a multilinear functional on V. For a fixed separable game 
we can extend the // from Ci to Vi similarly, yielding the so-called generalized moment 
functional, so ([T| holds with s replaced hy a G V. In polynomial games //(sj) = so 
the generalized moment functionals are just the classical moment functionals. We will abuse 
notation and identify the elements of Ci with the atomic measures in Aj, so Cj C A, C l^. 
Note that convCj and spanCj are the set of all finitely supported probability measures 
and the set of all finitely supported finite signed measures, respectively. The following are 
standard results (see [20] and [21]). 

Proposition 2.4. 

(a) The sets Ci and Aj are weak* compact. 

(h) The weak* closures of corw Ci and spanCj are Aj and Vi, respectively. 

(c) The weak* topology makes Vi a Hausdorff topological vector space. 

We next define three notions of equivalence between two measures, which allow us to 
exhibit simplifications in the structure of Nash equilibria in separable games. 
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Definition 2.5. Two measures cTj,rj G Vi are 

• moment equivalent if //(cxj) = fl{Ti) for all j (representation-dependent and only 
defined for separable games). 

• payoff equivalent if Uj{ai, S-i) = Uj{Ti, S-i) for all j and all S-i G C_j. 

• almost payoff equivalent if Uj{(Ji, S-i) = Uj{Ti, S-i) for all j ^ i and all s_j G C^j. 

Note that in separable games moment equivalence implies payoff equivalence and in all 
continuous games payoff equivalence implies almost payoff equivalence. Since the // and Uj 
are linear and multilinear functionals on Vi and V, respectively, these equivalence relations 
can be expressed in terms of (potentially infinitely many) linear constraints on (Xj — r,;. 

Definition 2.6. Let denote the zero measure in Vi and define 

• Wi = {measures moment equivalent to 0}, 

• Xi = {measures payoff equivalent to 0}, 

• Yi = {measures almost payoff equivalent to 0}. 

Then Wi Xi <0 Yi, and Ci ~ Ti G Xi if and only if cxj is payoff equivalent to Xj, 
etc. Furthermore, the subspaces Xi and Yi are representation-independent and well-defined 
for any continuous game, separable or not. Note that these subspaces are given by the 
intersection of the kernels of (potentially infinitely many) continuous linear functionals, hence 
they are closed. 

We will analyze separable games by considering the quotients of Vi by these subspaces, 
i.e. Vi mod these three equivalence relations. To avoid defining excessively many symbols 
let Ai/Wi denote the image of Aj in Vi/Wi and so forth. For a concrete example of these 
sets see the discussion at end of this section, and in particular Figure [TJ 

The following theorem presents a fundamental result about separable games. It shows 
that regardless of the choices of the other players, each player is free to restrict his choice of 
strategies to a particularly simple class of mixed strategies, namely those which only assign 
positive probability to a finite number of pure strategies. Furthermore, a bound on the 
number of strategies needed can be easily computed in terms of the structure of the game. 
This theorem can be proven by a separating hyperplane argument as applied to zero-sum 
separable games by Karlin [13], but here we give a new topological argument. 

Theorem 2.7. In a separable game every mixed strategy ai is moment equivalent to a finitely- 
supported mixed strategy Ti with \ supp(rj)| <mi + l. Moreover, if ai is countahly- supported 
Ti can be chosen with supp(rj) C supp(crj). 

Proof. Note that the map 

/,:a,H-(//(a,),...,/r(a.)) (3) 
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is linear and continuous. Therefore 



/i(Ai) = fi (convQ) C fi{convCi) = conv fi^d) = conv fi^Q) = /^(convCj) C /^(Ai 



The first three steps follow from Proposition 2.4, continuity of and linearity of fi, respec 



tively. The next equality holds because conv/j(Cj) is compact, being the convex hull of a 
compact subset of a finite-dimensional space. The final two steps follow from the linearity 
of fi and the containment convC^ C Aj. Hence, we have 

/i(Ai) = conv/i(Ci) = /-(convCj). 

This shows that any mixed strategy is moment equivalent to a finitely-supported mixed 
strategy. Applying Caratheodory's theorem [2] to the set conv/j(Cj) C M"*' yields the 
uniform bound. Since a countable convex combination of points in a bounded subset of M"*' 
can always be written as a finite convex combination of at most + 1 of those points, the 
final claim follows. □ 

For the rest of the paper we will study the Nash equilibria of (nonzero-sum) separable 
games, which are defined for arbitrary continuous games as follows. 

Definition 2.8. A mixed strategy profile a is a Nash equilibrium if Uj(rj,cr_j) < Ui{a) 
for all i and all r, G A,. 



Combining Theorem 2.7 with Glicksberg's result [TOj that every continuous game has a 



Nash equilibrium yields the following: 

Corollary 2.9. Every separable game has a Nash equilibrium in which player i mixes among 
at most rrii + 1 pure strategies. 

Example 2.3 (cont'd). Apply the standard definition of the // to the polynomial game with 
payoffs given in pi). The set of moments Ai/Wi = /i(Aj) as described in Theorem 2.7 



IS 



shown in Figure n1 with the zeroth moment omitted (it is identically unity) . In this case the 
set of moments is the same for both players. The space Vi/Wi = fi{Vi) is a four-dimensional 
real vector space, and Figure [l] shows a subset of the projection of Vi/Wi onto its final three 
coordinates. The set Ci/Wi = fiiCi) of moments due to pure strategies is the curve traced 
out by the vector (1, x, x^, x^) as x varies from —1 to 1. Since the first coordinate is omitted 
in the figure, this can be seen as the sharp edge which goes from (—1, 1, —1) through (0, 0, 0) 
to (1, 1, 1). As shown in the proof of Theorem |2.7[ /i(Aj) is exactly the convex hull of this 
curve. 

For each player the range of the indices in ([T]) is < jj < 3, so by Corollary 2.9 , this game 



has an equilibrium in which each player mixes among at most 4 + 1 = 5 pure strategies. 
To produce this bound, we have not used any information about the payoffs except for 
the degree of the polynomials. However, notice that there is extra structure here to be 
exploited. For example, U2 depends on the expected value / x'^dai{x), but not on J xdai{x) 
or J x^d(Ji{x). In particular, player 2 is indifferent between the two strategies ±a: of player 1 
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Figure 1: The space /i(Aj) = Aj/Wj of possible moments for either player's mixed strategy 
under the payoffs given in g due to a measure on [—1, 1]. The zeroth moment, which is 
identically unity, has been omitted. 

for all X, insofar as this choice does not affect his payoff (though it does affect what strategy 
profiles are equilibria). In the following section, we will present improved bounds on the 
number of strategies played in an equilibrium which take these simplifications into account 
in a systematic manner. 



3 The Rank of a Continuous Game 

In this section, we introduce the notion of the rank of a continuous game. We use this notion 
to provide improved bounds on the cardinality of the support of the equilibrium strategies for 
a separable game. We also provide a characterization theorem which states that a continuous 
game has finite rank if and only if it is separable, thus showing that separable games are 
the largest class of continuous games to which low-rank arguments apply (see subsection 



3.2). We conclude this section by showing how to compute the rank of a separable game 



in Subsection |3.3[ which may be read independently of the section on the characterization 
theorem. 

Our main result on bounding the support of equilibrium strategies generalizes the fol- 
lowing theorem of Lipton et al. [16] to arbitrary separable games, thereby removing the 
two-player assumption and weakening the restriction that the strategy spaces be finite. The 
proof given in [16] is essentially an algorithmic version of Caratheodory's theorem. Here 
we provide a shorter nonalgorithmic proof which illustrates some of the ideas to be used in 
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establishing the extended version of the theorem. 

Theorem 3.1 (Lipton et ah [16]). Consider a two-player finite (i.e. bimatrix) game defined 
by matrices R and C of payoffs to the row and column player, respectively. Let a be a Nash 
equilibrium of the game. Then there exists a Nash equilibrium r which yields the same payoffs 
to both players as a, but in which the column player mixes among at most rank R + 1 pure 
strategies and the row player mixes among at most rank C + 1 pure strategies. 

Proof. Let r and c be probabihty column vectors corresponding to the mixed strategies of 
the row and column players in the given equilibrium a. Then the payoffs to the row and 
column players are r'Rc and r'Cc. Since c is a probability vector, we can view Rc as a convex 
combination of the columns of R. These columns all lie in the column span of i?, which is a 
vector space of dimension ranki?. By Caratheodory's theorem, we can therefore write any 
convex combination of these vectors using only rank R+1 terms [2j . That is to say, there is 
a probability vector d such that Rd = Rc, d has at most rank i? + 1 nonzero entries, and a 
component of d is nonzero only if the corresponding component of c was nonzero. 

Since r was a best response to c and Rc = Rd, r is a best response to d. On the other 
hand, since (r, c) was a Nash equilibrium c must have been a mixture of best responses to r. 
But d only assigns positive probability to strategies to which c assigned positive probability. 
Thus (i is a best response to r, so (r, d) is a Nash equilibrium which yields the same payoffs 
to both players as (r, c), and d only assigns positive probability to ranki?+ 1 pure strategies. 
Applying the same procedure to r we could find an s which only assigns positive probability 
to rank C + 1 pure strategies and such that (s, is a Nash equilibrium with the same payoffs 
to both players as (r, c). □ 

We will show in the following subsection that our extension of this theorem provides a 
slightly tighter bound of rank R instead of rank R + 1 (respectively for C) in some cases, 
depending on the structure of R and C. This can be seen directly from the proof given here. 
We considered convex combinations of the columns of R and noted that these all lie in the 
column span of R. In fact, they all lie in the affine hull of the set of columns of R. If this 
affine hull does not include the origin, then it will have dimension ranki? — 1. The rest of 
the proof goes through using this affine hull instead of the column span, and so in this case 
we get a bound of ranki? on the number of strategies played with positive probability by 
the row player. Alternatively, the dimension of the affine hull can be computed directly as 
the rank of the matrix given by subtracting a fixed column of R from all the other columns 
of R. 



3.1 Bound on the Support of Equilibrium Strategies 

By comparing the two-player case of ([T]) with the singular value decomposition for matrices, 
separable games can be thought of as games of "finite rank." Now we will define the rank of 
a continuous game precisely and use it to give a bound on the cardinality of the support of 
equilibrium strategies, generalizing Corollary 2.9 and Theorem |3.1[ The primary tool will be 
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the notion of almost payoff equivalence from Definition 2.5 In what follows, the dimension 
of a set will refer to the dimension of its affine hull. 



Definition 3.2. The rank of a continuous game is defined to be the n-tuple p = (pi, . . . , p„) 
where = dim A game is said to have finite rank if pj < oo for all i. 

Since Wi C Yi and Vi/Wi is finite-dimensional for any separable game (see the proof of 



Theorem 2.7), it is clear that separable games have finite rank, and furthermore that pi < rrii 



for all i. In subsection 3.2 we show that all games of finite rank are also separable, so the 
two conditions are equivalent. Unlike the m,, the rank is defined for all continuous games 
and is representation-independent. 

We define the rank of a game in terms of almost payoff equivalence of mixed strategies 
by means of the subspace Yi. This notion of equivalence between two strategies for a given 
player means that no matter what the other players do, their payoffs will not enable them 
to distinguish these two strategies. The use of this equivalence relation reflects the fact that 
at a (mixed strategy) Nash equilibrium, the payoff to a player is equalized among all pure 
strategies which he plays with positive probability. Therefore the player is free to switch to 
any other mixed strategy supported on the same pure strategies, as long as the change does 
not affect the other players, and the resulting strategy profile will remain a Nash equilibrium. 



Using the rank of a game. Corollary |2. 9 and Theorem |3.1 can now be improved as follows: 



Theorem 3.3. Given an equilibrium a of a separable game with rank p, there exists an 
equilibrium t such that each player i mixes among at most pj + 1 pure strategies and Ui{a) = 
Uiir). 

If dim Ai/Xi = 1 and the metric space Ci is connected, then this bound can be improved 
so that Ti is a pure strategy. 



Proof. By Theorem |2.7[ we can assume without loss of generality that each player's mixed 
strategy cTj is finitely supported. Fix i, let ipi : Vi ^ Vi/Yi denote the canonical projection 
transformation and let cxj = X^sj be a finite convex combination of pure strategies. By 
linearity of ipi we have 

j 

Caratheodory's theorem states that (renumbering the s^ and adding some zero terms if 
necessary) we can write 

pi 

j=0 

a convex combination potentially with fewer terms. Let = Yl'jLo f^'' 4 ■ Then tpi{ai) = 
ipi{Ti). Since a was a Nash equilibrium, and cTj is almost payoff equivalent to r^, cTj is a best 
response to (xj, cr_ij) for all j ^ i. On the other hand (Tj was a mixture among best responses 
to the mixed strategy profile cT_j, so the same is true of r^, making it a best response to 
Thus (Tj, cr_j) is a Nash equilibrium. 
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If dimAj/Xj = 1 and Cj is connected, then Ci/Xi is connected, compact, and one- 
dimensional, i.e. it is an interval. Therefore it is convex, so Aj/Xj = conv(Cj/Xj) = Ci/Xi. 
This implies that there exists a pure strategy Si which is payoff equivalent to (jj, so we may 
take Ti = Si and (tj, a-i) is a Nash equilibrium. 

Beginning with this equilibrium and repeating the above steps for each player in turn 
completes the construction of r and the final statement of the theorem is clear. □ 

While the preceding theorem was the original reason for our choice of the definition of 
p, the definition turns out to have other interesting properties which we study below. The 
following alternative characterization of the rank of a continuous game is more concrete than 
the definition given above. This theorem simplifies the proofs of many rank-related results 
and will be applied to the problem of computing the rank of separable games in Subsection 



Theorem 3.4. The rank pi for player i in a continuous game is given by the smallest 
such that there exist continuous functions : Cj ^ M and hfj : C_j M which satisfy 

nj{s) = hl^{s^i) + (4) 
fc=i 

for all s & C and j ^ i (pi = oo if and only if no such representation exists). Furthermore, 
the minimum value of Vi = pi is achieved by functions gi{si) of the form Uj{si, S-i) for some 
s_j G C_j and j i and functions h^ j{s^i) of the form J Uj{-, s^i)dai for some ai G V^. 

Proof. Throughout the proof we will automatically extend any functions g^ : Cj — > M to 
all of Vi in the canonical way. Suppose we are given a representation of the form Q. Let 
gi : Ci be defined by gi{si) = {g}{si), . . . ,gl^{si)). By definition, pi is the dimension of 

Ai/Yi. Let Zi denote the subspace of Vi parallel to A,, i.e. the space of all signed measures 
CTj such that / = 0. Then pi = dim Zi/{Zi fl Yi). By Q any signed measure which is in 
Zi and in ker gi is almost payoff equivalent to the zero measure, so Zi fl ker C fl and 
therefore 

Pi = dim Zi/{Zi n Yi) < dim Zi/{Zi n kei g-i) = dim gi{Zi) < Ti. 

It remains to show that if p, < oo then there exists a representation of the form (|4]) with 
ri = Pi. Recall that is defined to be 

Yi= Pi kerMj(-,s_i) 

S —i^C —i 

where s_j) is interpreted as a linear functional on Vi. Since pi = dim Zi/ {ZiHYi), we can 
choose Pi linear functionals, call them gj, . . . ,g'^', from the collection of functionals whose 
intersection forms Yi, such that Zi HYi = Zi n ker gi, where gi = [g], . . . ,g'/') as above. We 
cannot choose a smaller collection of linear functionals and achieve Zj (1 Yi = Zi (1 ker gi, 
because pi = dim Zi/^ZiHYi). Note that Zjflker^fj = keT{l,gl, . . . ,g^^) where 1 is the linear 
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functional = J dai. Therefore no functional can be removed from the list = 

{l,gl,. . . ,gi') without affecting the kernel of the transformation {l,gi), so the functionals 
1, gj , . . . , g'^' are linearly independent. 

This means that any of the linear functionals Uj{-, S-i) (the intersection of whose kernels 
yields Yj) can be written uniquely as a linear combination of the functionals l,gl, . . . ,g^' . 
That is to say, there are unique functions h'^j such that Q holds with the functions g'l 
constructed here and rj = pj. The g^ are continuous by construction, so to complete the 
proof we must show that the functions h^j are continuous as well. Since the functionals 
1, gj , . . . , g^' are linearly independent, we can choose a measure erf G which makes the 
k^^ of these functionals evaluate to unity and all the others zero. Substituting these values 
into Q shows that h^j{s^i) = J Uj{-, s^i)da'l . Since Uj is continuous, /ifj is therefore also 
continuous. □ 



Note that in the statement of Theorem 3.4|we have distinguished the component h^j{s 



in Uj. We have shown that this distinction follows from the definition of pi, but there is also 
an intuitive game theoretic reason why this separation is natural. As mentioned above, pi 
is intended to capture the number of essential degrees of freedom that player i has in his 



choice of strategy when playing a Nash equilibrium. Theorems |3.3| and |3.4| together show 
that player i only needs to take the other players' utilities into account to compute this 
number, and not his own. But player i is only concerned with the other players' utilities 
insofar as his own strategic choice affects them. The function - {s^i) captures the part of 
player j's utility which does not depend on player z's strategy, so whether this function is 
zero or not it has no effect on the rank pj. 



Also note that while Theorem 3^ gives decompositions of the utilities in terms of the pi, 
it is not in general possible to summarize all these decompositions by writing the utilities 
in the form ([T]) with = p, for all i. For a trivial counterexample, consider any game in 
which Ui{s) = /i^(s_j) is independent of for all i. Then Theore m |3.4| implies that Pi = 
for all i, but the utilities are nonzero so we cannot take mj = in (llj) for any i. 

We close this subsection with an application. If a submatrix is formed from a matrix 
by "sampling," i.e. selecting a subset of the rows and columns, the rank of the submatrix 



is bounded by the rank of the original matrix. Theorem 3.4 shows that the same is true of 
continuous games, because a factorization of the form ^ for a game immediately provides a 
factorization for any smaller game produced by restricting the players' choices of strategies. 

Corollary 3.5. Let ({Cj}, be a continuous game with rank p and Ci be a nonempty 

compact subset of Ci for each i, with Ui = Ui\^,. Let p denote the rank of the game 
{{Ci}, {ui}). Then we have pi < pi for all i. 



Definition 3.6. The game ({Cj}, {ui}) in Corollary 3.5 is called a sampled game or a 
sampled version of ({Cj}, {wj}). 

Note that if we take Ci to be finite for each then the sampled game is a finite game. If 
the original game is separable and hence has finite rank, then Corollary |3.5 yields a uniform 



bound on the complexity of finite games which can arise from this game by sampling. This 
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fact is applied to the problem of computing approximate equilibria in Section |4] below. 
Finally, note that there are other kinds of bounds on the cardinality of the support of 
equilibria (e.g., for special classes of polynomial games as studied by Karlin [13]) which do 
not share this sampling property. 



3.2 Characterizations of separable games 

In this section we present a characterization theorem for separable games. We also provide 
an example that shows that the assumptions of this theorem cannot be weakened. 

Theorem 3.7. For a continuous game, the following are equivalent: 

1. The game is separable. 

2. The game has finite rank. 

3. For each player i, every countably supported mixed strategy ai is almost payoff equiva- 
lent to a finitely supported mixed strategy Ti with supp(rj) C supp(crj). 



To prove that finite rank implies separability we repeatedly apply Theorem 3.4 The 
proof that the technical condition ^ implies ^ uses a linear algebraic argument to show 
that span Ci/Yi is finite dimensional and then a topological argument along the lines of the 



proof of Theorem 2.7 to show that Vi/Yi is also finite dimensional. 



After the proof of Theorem |3.7| we will give an explicit example of a game in which 
all mixed strategies are payoff equivalent to pure strategies, but for which the containment 
supp(r-j) C supp(crj) in condition ^ fails. In light of Theorem 3.7 this will show that the 



constructed game is nonseparable and that the containment supp(rj) C supp((jj) cannot be 
dropped from condition ([3]), even if the other assumptions are strengthened. 




r|=^[3]) This was proven in Theorem 2.7 



2h This follows from the proof of Theorem 2.7 



2 ^ rU) We will prove this by induction on the number of players n. When n = 1 the 



statement is trivial and the case n = 2 follows immediately from Theorem |3.4[ Suppose 
we have an n-player continuous game with pi < oo for all i and that we have proven that 
pi < oo for all i implies separability for [n — l)-player games. By fixing any signed measure 
(Jn G Vn we can form an [n — l)-player continuous game from the given game by removing 
the n^^ player and integrating all payoffs of players i < n with respect to cr„, yielding a new 
game with payoffs Ui{s-n) = J Ui{sn, S-n)d(Jn{sn)- 

From the definition of Yi, it is clear that 1^ C 1^ for all 1 < i < n. Therefore pi = 
dimAi/Yi < dimAj/y, = pi < oo for 1 < z < n so the {n — l)-player game has finite rank. 
By the induction hypothesis, that means that the function ui is a separable function of the 



strategies Si, . . . , Sn-i- Theorem 3.4 states that there exist continuous functions g'^ and h'^^^ 
such that 

Pn 

Ms) = <i(S-n) + 9n{Sn)hll{S-n) (5) 

fe=l 
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where h^i = f Wi(s)(icr^ for some cr^ G Vn- Therefore by choosing (j„ appropriately we can 
make ui = h^ i for any fc, so h'^ i{s^n) is a separable function of si, . . . for all fc. By 

(|5| Ui is a separable function of si, . . . , Sn- The same argument works for all the Ui so the 
given game is separable and the general case is true by induction. 

([3] ^ [2]) Let : Vi ^ Vi/Yi be the canonical projection transformation. First we will 
prove that span'?/'j(Cj) is finite dimensional. It suffices to prove that for every countable 
subset Ci = {sj, sf, . . .} C d, the set il^i{Ci) is linearly dependent. Let {p^} be a sequence 
of positive reals summing to unity. Define the mixed strategy 



CTi = 

k=l 



By assumption there exists an M and q^, . . . , q^^ > summing to unity such that 

/ M \ M 



,fc=i / fc=i 



Let a = > and define the mixed strategy 



k=M+l 



00 u 

^ — ^ a 

k=M+l 



Applying the assumption again shows that there exist N and r^^"^^, . . . such that 

/ N \ N 



Therefore 



M / M 



k=l \k=l / 

M N 



k=l fc=M+l 

and rearranging terms shows that 'Ylk=iiP^ ~ + J2k=M+i^^'''^ii^i) ~ 0- ^^^^ 

^ Q''^) = ^ci; < 0, so p*^ — g'^ 7^ for some k. Therefore ipi{Ci) is hnearly dependent, 
so span ?/^j(Ci) is finite dimensional. 

Since Yi is closed, Vi/Yi is a Hausdorff topological vector space under the quotient topol- 
ogy and ipi is continuous with respect to this topology [21j. Being finite dimensional, the 
subspace span'?/^i(Ci) C Vi/Yi is also closed pT]. Thus we have 



Vi/Yi = ipiiV) = Ipi (spanCi) C ^j(spanCi) = span'ipi{Ci) = spa,m}ji{Ci) C Vi/Yi 
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where the first step is by definition, the second follows from Proposition 2.4, the next two 
are by continuity and linearity of ipi, and the final two are because span'?/'j(Cj) is a closed 
subspace of Vi/Yi. Therefore pi = dim Aj/Fj < dim Vi/Fj = dim span '?/'j(Ci) < oo. 

□ 

The following counterexample shows that the containment supp Xj C supp CTj is a nec- 
essary part of condition |3] in Theorem 3/7 by showing that there exists a nonseparable 
continuous game in which every mixed strategy is payoff equivalent to a pure strategy. 

Example 3.8. Consider a two-player game with Ci = C2 = [0, l]"^, the set of all infinite 
sequences of reals in [0, 1], which forms a compact metric space under the metric 



d{x, x') = sup 



Define the utilities 



ui{x,y) = U2{x,y) = 'xiyi 



1=1 



To show that this is a continuous game we must show that ui is continuous. Assume 
d{x,x'),d{y,y') < S. Then \xi — x'J < 6i and \yi — ?/-| < Si, so 



\ui{x,y) - ui{x',y')\ 



5^2 '{x^yi- x'iy'i) 



i=l 



= ^ 2 '{xiyi - x% + x% - x-y.) 
1=1 

i=l 

00 / 00 \ 

< ^2-^(25i) = I 2^2-^2 1 6. 



i=l 



1=1 



Thus Ml = U2 is continuous (in fact Lipschitz), making this a continuous game. 

Let a and r be mixed strategies for the two players. By the Tonelli-Fubini theorem, 



ui[a,T 



j uid{a X r) = ^2 ' (^j Xida^ (^j yidr^ . 



Thus a is payoff equivalent to the pure strategy (/ xida, J X2da, . . .) G Ci and similarly for 
r, so this game has the property that every mixed strategy is payoff equivalent to a pure 
strategy. 

Finally we will show that this game is nonseparable. Let e* G Ci be the element having 
component i equal to unity and all other components zero. Let {pi} be a sequence of positive 
reals summing to unity and define the probability distribution cr = Yli^iPi^^ ^ ^i- Suppose 
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cr were almost payoff equivalent to some mixture among finitely many of the e*, call it 
T = Yl'j^ili^^ where Qi = for i greater than some fixed A^. Let e^+i be the strategy for 
player 2. Then the payoff if player 1 plays a is 

Similarly, if he chooses r the payoff is 2~*^^+^)giv+i- Since Pn+i > and ^at+i = 0, this 
contradicts the assumption that a and r are almost payoff equivalent. Thus condition [3] of 



Theorem 3.7 does not hold, so this game is not separable. 

Therefore the condition that all mixed strategies be payoff equivalent to finitely supported 
strategies does not imply separability, even if a uniform bound on the size of the support is 
assumed. Hence the containment supp x; C supp cannot be removed from condition |3] of 
Theorem 13. 71 

3.3 Computing the rank of a separable game 

In this subsection we construct a formula for the rank of an arbitrary separable game and 
then specialize it to get formulas for the ranks of polynomial and finite games. For clarity of 
presentation we first prove a bound on the rank of a separable game which uses an argument 
that is similar to but simpler than the argument for the exact formula. While it is possible 
to prove all the results in this section directly from the definition pi = dimAj/1^, we will 
give proofs based on the alternative characterization in Theorem |3.4 because they are easier 



to understand and provide more insight into the structure of the problem. 

Given a separable game in the standard form ([T]), construct a matrix Sij for players i 
and j which has columns and Uk-^ifrik rows and whose elements are defined as follows. 
Label each row with an (n — l)-tuple (/i, . . . , /j+i, ...,/„) such that 1 < 4 < ^k] the 
order of the rows is irrelevant. Label the columns h = 1, . . . ,mi. Each entry of the matrix 
then corresponds to an n-tuple (/i, ...,/„). The entry itself is given by the coefficient a^-^ 
in the utility function uj. 

Let fi{si) denote the column vector whose components are fl{si), . . . , f^^{si) and f^i{s^i) 
denote the row vector whose components are the products (si) ■ ■ ■ fl'Si (si+i) ■ ■ ■ ft 

ordered in the same way as the (n — l)-tuples (/i, . . . , k-i, Zj+i, ...,/„) were ordered above. 
Then Uj{s) = f_i{s_i)Sijfi{si). 

Example 3.9. We introduce a new example game to clarify the subtleties of computing ranks 
when there are more than two players; we will return to Example 2.3| later. Consider the 



three player polynomial game with strategy spaces Ci = C2 = C3 = [—1,1] and payoffs 

ui{x, y, z) = 1 + 2x + 3x^ + 2yz + Axyz + Qx^yz 

+ ?,y'^z^ + Qxy'^z^ + ^x'^y'^z'^ 
U2{x, y, z) = 7 + 2x + 3x'^ + 2y + Axy + Qx^y 

+ 3z'^ + Qxz'^ + 9x^z'^ ^ ^ 

Usi^x, y, z) = —z — 2xz — 3x'^z — 2yz — Axyz — Qx^yz 
— ^yz^ — Qxyz^ — Qx^yz^ 
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where x, y, and z are the strategies of player 1, 2, and 3, respectively. Order the functions 
fl so that = [l X x^] and similarly for /2 and /s with x replaced by y and z, 

respectively. If we wish to write down the matrices Si^2 and 5*1^3 we must choose an order for 
the pairwise products of the functions /2 and f!^. Here we will choose the order f-i{y, z) = 
\l y y"^ z yz y'^z z"^ yz^ y'^z^]- We can write down the desired matrices immediately 
from the given utilities. 



Si, 



'7 


2 


3" 




' 





" 


2 


4 


6 












































-1 


-2 


-3 













-2 


-4 


-6 






















3 
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9 
























-3 


-6 


-9 























This yields U2{x,y,z) = f^i{y,z)Si^2fi{x) and U3{x,y,z) = f_i{y,z)Si-sfi{x) as claimed. 

Define Si to be the matrix with rrii columns and (n — l)Ilj^imj rows which consists of all 
the matrices Sij for j i stacked vertically (in any order). In the example above, Si would 
be the 18 x 3 matrix obtained by placing above on the page. 

Theorem 3.10. The rank of a separable game is bounded by pi < rank 5*4. 

Proof. Using any of a variety of matrix factorization techniques (e.g. the singular value 
decomposition), we can write Si as 



rank Si 
k=l 



for some column vectors and row vectors w^. The vectors will have length {n—l)'n.j-Limj 
since that is the number of rows of Si. Because of the definition of S'j, we can break each 
into n — 1 vectors of length Uj-^irrij, one for each player except i, and let Vj be the vector 
corresponding to player j. Then we have 



Si,j 



rank Si 

E 

k=l 



for all j 7^ i. Define the linear combinations gf{si) = w^fi{si) and h^j = f_i{s_i)Vj, which 
are obviously continuous functions. Then 



rank Si 



{s) = f^i{s^i)Sijfi{s^) = J2 9i{si)hl^{s^ 



k=l 



for all s G C and j 7^ i, so pi < rank Si by Theorem 3.4 



□ 
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Example 3.11. To demonstrate the power of the bound in Theorem 3.10 we will use it to give 



an immediate proof of Theorem |3.1[ Consider any two-player finite game, where the first 
player chooses rows and the second player chooses columns. Let Ci = {1, . . . , rrii} for i = 1,2 
and let R and C be the matrices of payoffs to the row and column players, respectively. We 
can then define //(si) to be unity if Sj = Z and zero otherwise. This gives 

Ul{Si,S2) = /l(Sl)'-R/2(s2) 
M2(Sl,S2) = f 2(82)0' fi{Si) 

SO 5*1 = C and S2 = R- Therefore by Theorem |3.10| pi < rank Si = rank C and p2 < 
rank 5*2 = ranki?. Substituting these bounds into Theorem 3^ yields Theorem 3J^, so we 
have in fact generalized the results of Lipton et al. [16] . 



It is easy to see that there are cases in which the bound in Theorem |3.10| is not tight. 
For example, this will be the case (for generic coefficients a]^' "'") if mj > 2 for each i and ff 
is the same function for all k. 

Fortunately we can use a technique similar to the one used above to compute pi exactly 
instead of just computing a bound. To do so we need to write the utilities in a special form. 
First we add the new function //(sj) = 1 to the list of functions for player i appearing in the 
separable representation of the game if this function does not already appear, relabeling the 
other as necessary. Next we consider the set of functions {fj} for each player j in turn 
and choose a maximal linearly independent subset. For players j ^ i any such subset will 
do; for player i we must include the function which is identically unity in the chosen subset. 
Finally we rewrite the utilities in terms of these linearly independent sets of functions. This 
is possible because all of the fj are linear combinations of those which appear in the maximal 
linearly independent sets. 

From now on we will assume the utilities are in this form and that fl{si) = 1. Let Sij 
and Si be the matrices Sij and Si defined above, where the bar denotes the fact that we have 
put the utilities in this special form. Let Tj be the matrix Si with its first column removed. 
Note that this column corresponds to the function fl{si) = 1 which we have distinguished 
above, and therefore represents the components of the utilities of players j ^ i which do not 



depend on player i's choice of strategy. As mentioned in the note following Theorem 3^ 
these components don't affect the rank. This is exactly the reason that we must remove the 
first column from Si in order to compute pi. We will prove that pi = rankT,, but first we 
need a lemma. 

Lemma 3.12. If the functions fj{sj), . . . , fj^^ (sj) are linearly independent for all j , then the 
set of all irj^inij product functions of the form /f^(si) ■ ■ ■ fn"{sn) is a linearly independent 
set. 

Proof. It suffices to prove this in the case n = 2, because the general case follows by induction. 
We prove the n = 2 case by contradiction. Suppose the set were linearly dependent. Then 
there would exist Xkik2 not all zero such that 

mi m2 

EE^'^^^^/'^(^l)/2^(^2)=0 (7) 
ki = l k2 = l 
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for all s G C. Choose li and I2 such that Xi-^^i^ 7^ 0. By the linear independence assumption 
there exists a finitely supported signed measure (T2 such that J /2 ^(72 is unity for k = I2 and 
zero otherwise. Integrating ([T]) with respect to o"2 yields 



mi 



fci=i 

contradicting the linear independence assumption for fl, . . . , □ 

Theorem 3.13. // the representation of a separable game satisfies fl = 1 and the set 
{fj, . . . , fj^^} is linearly independent for all j then the rank of the game is pi = rankTj. 

Proof. The proof that pi < rankTj follows essentially the same argument as the proof of 
Theorem 3.10 We use the singular value decomposition to write Tj as 

rank Ti 



k=l 



for some column vectors and row vectors . The vectors will have length [n—Vjllj-Li 
since that is the number of rows of Si. Let f° be the first column of Si, which was removed 
from Si to form Tj. Because of the definition of Tj and Sj, we can break each into n — 1 
vectors of length Uj-^irrij, one for each player except i, and let Vj be the vector corresponding 
to player j. Putting these definitions together we get 

rank T; 



Si,j = v^j[i ■ ■ ■ 0] + ^ v"; [0 w'^] 



k=l 

Define the linear combinations gf{si) = [O w''~\ fi{si) and h^-{s^-^ = f^i{s^i)vj, which 
are obviously continuous functions. Then 

rank Ti 

Uj{s) = f-^{s^i)SiJi{si) = h^is.i) + 9i{si)hlj{s-i) 

k=l 



for all s G C and j 7^ i, so pi < rankTj by Theorem 3.4 



To prove the reverse inequality, choose continuous functions gi{si) and h^j{s-i) such that 

Pi 

k=l 



holds for all s G C and j 7^ i. By Theorem 3.4 we can choose these so that gf{si) is of the 
form Uj{si, s_j) for some s_j G C_i,j 7^ i andhfj{s_i) is of the form J Uj{-, s_i)dai for some 
cxj G Vi. Substituting these conditions into equation ([T| defining the form of a separable 
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game shows that Qi^Si) = fi{si) for some row vectors and /ifj = f-i{s^i)Vj for some 
column vectors Vj. Define w° = [l ■ ■ ■ O] . Then 



Uj[S) 



k=0 

for all s G C and j ^ i. 

This expresses Uj{s) as a linear combination of products of the form /i^(si) ■ ■ ■ /^"(s^ 
By assumption the sets j/^^, . . . , fj'^} are linearly independent for all j, and therefore the 



set of products of the form /i^(si) ■ ■ ■ is linearly independent by Lemma 3.12 Thus 

the expression of Uj{s) as a linear combination of these products is unique. 

But we also have Uj{s) = /_j(s_j)'S'jj/j(sj) by definition of Sij, so uniqueness implies 
that Sij = ^fcLo '^j''^^- Let v'^ be the vector of length {n — l)IljjLimj formed by concatenating 
the Vj in the obvious way. Then Si = Ylk=o '^^w^- Let be with its first entry removed. 
By definition of Tj we have Tj = XlfcLo"^^^^- standard unit vector with a 1 in 

the first coordinate, so is the zero vector and we may therefore remove the = term 
from the sum. Thus Tj = 'Yl,k=i v^w^ ■, which proves that rankTj < pi. □ 

As corollaries of Theorem |3.13 we obtain formulas for the ranks of polynomial and finite 
games. 

Corollary 3.14. Consider a game with polynomial payoffs 

mi— 1 m„— 1 

<^)= E ■■■ E «r""^i^---^^ (8) 

ji=0 j„=0 

and compact strategy sets Q C M which satisfy the cardinality condition \Ci\ > rrii for all i. 
Then Ti is Si with its first column removed and pi = rankTj. 

Proof. Linear independence of the fl follows from the cardinality condition and we have 



/j = 1, so Theorem 3.13 applies. □ 

Example 2.3 (cont'd). Applying this formula to the utilities in ^ shows that pi = 1 and 
P2 = 3. 

Example 3.9 (cont'd). Applying this formula to the utilities in ^ shows that in this case 
pi = 1 and P2 = P3 = 2. 

Corollary 3.15. Consider an n-player finite game with strategy sets Ci = {1, . . . ,mj} and 
payoff ttj^'"'*" to player i if the players play strategy profile (si, . . . , Sn)- The utilities can be 
written as 

mi nin 
ii=i in=l 

where fl{si) is unity if Si = l and zero otherwise. Let Si he the matrix for player i as defined 
above and letci,..., Cm, be the columns of Si. Then we may take Tj = [c2 — Ci ■ ■ ■ — Ci] 
and Pi = rankTj. 
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Proof. If we replace // with the function which is identically unity then the linear indepen- 



dence assumption on the fl will still be satisfied, so we can apply Theorem 3.13 After this 



replacement, the coefficients in the new separable representation for the game are 



— a 



if = 1, 

if 7^1. 



Therefore if Ci, . . . , Crm are the columns of Si from the original representation of the game 



we get Si = [ci C2 - Ci 



3.13 completes the proof. 



— Ci] , so Ti is as claimed and an application of Theorem 

□ 



4 Computation of Nash Equilibria and Approximate 
Equilibria 

In this section, we study computation of exact and approximate Nash equilibria. We first 
present an optimization formulation for the computation of (exact) Nash equilibria of general 
separable games. We show that for two-player polynomial games, this formulation has a 
biaffine objective function and linear matrix inequality constraints. We then present an 
algorithm for computing approximate equilibria of two-player separable games with infinite 
strategy sets which follows directly from the results on the rank of games given in Section |3] 
and compare it with known algorithms for finite games. 

4.1 Computing Nash equilibria 

The moments of an equilibrium can in principle be computed by nonlinear programming 
techniques using the following generalization of the Nash equilibrium formulation presented 
by Ba§ar and Olsder |1J: 

Proposition 4.1. The following optimization problem has optimal value zero and the vari- 
ables X in any optimal solution are the moments of a Nash equilibrium strategy profile with 
payoff Pi to player i: 

max YA=i{^ii^) - Pi] 

s.t. Xi e Ai/Wi = fi{Ai) for all i 

Vi{fi{si),x_i) < Pi for all i, all Si G Q 

The function fi is the moment function defined in ^ and Vi is the payoff function on the 
moment spaces defined by Vi (/i(cri), . . . , fn{o'n)) = 'Wj(cr). 

Proof. The constraints imply that Vi{x) —pi < for all i, so the objective function is bounded 
above by zero. Given any n-tuple of moments x which form a Nash equilibrium, let Pi = Vi{x) 
for all i. Then the objective function evaluates to zero and all the constraints are satisfied, 
by definition of a Nash equilibrium. Therefore the optimal objective function value is zero 
and it is attained at all Nash equilibria. 
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Conversely suppose some feasible x and p achieve objective function value zero. Then 
the condition Vi{x) —pi<0 implies that Vi{x) = pi for all i. Also, the final constraint implies 
that player i cannot achieve a payoff of more than pi by unilaterally changing his strategy. 
Therefore the moments x form a Nash equilibrium. □ 

To compute equilibria by this method, we require an explicit description of the spaces 
of moments Aj/Wj. We also require a method for describing the payoff pi to player i if he 
plays a best response to an m_j-tuple of moments for the other players. 

While it seems doubtful that such descriptions could be found for arbitrary //, they do 
exist for two-player polynomial games in which the pure strategy sets are intervals. In this 
case they can be written in terms of linear matrix inequalities as in Parrilo's treatment of the 
zero-sum case |19j. This yields a problem with biaffine objective and linear matrix inequality 
constraints. 

Example 2.3 (cont'd). Directly solving this nonconvex problem with MATLAB's fmincon 
has proven error-prone, as there appear to be many local minima which are not global. 
However, we were able to compute the equilibrium measures 

(Ti = 0.55325(a; + 1) + 0.44685(s - 0.1149), 
a2 = 5{y - 0.7166) 

(i.e. player 1 plays the pure strategy x = —1 with probability 0.5532 and so on) for the 
payoffs in (|2]) by this method. 

4.2 Computing e-equilibria 

The difficulties in computing equilibria by general nonconvex optimization techniques suggest 
the need for more specialized systematic methods. As a step toward this, we present an 
algorithm for computing approximate Nash equilibria of two-player separable games. There 
are several possible definitions of approximate equilibrium, but here we will use: 

Definition 4.2. A mixed strategy profile cr G A is an e-equilibrium (e > 0) if 

Ui{si,a_i) < Ui{a) + e 

for all Si G Ci and i = 1, . . . , n. 

For e = 0, the definition of an e-equilibrium reduces to that of a Nash equilibrium. We 
consider computing an e-equilibrium of separable games that satisfy the following assump- 
tion: 

Assumption 4.3. 

• There are two players. 

• The game is separable. 
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• The utilities can be evaluated efficiently. 

To simplify the presentation of our algorithm, we also adopt the following assumption: 
Assumption 4.4. 

• The strategy spaces are Ci = C2 = [— 1, 1]. 

• The utility functions are Lipschitz. 



In the description of the algorithm we will emphasize why Assumption 4.3 is needed for 
our analysis. After presenting the algorithm we will discuss how Assumption AA could be 
relaxed. 

Theorem 4.5. For e > 0, the following algorithm computes an e- equilibrium of a game 



of rank p satisfying Assumptions 4-3 and 4-4 time polynomial in - for fixed p and time 



polynomial in the components of p for fixed e (for the purposes of asymptotic analysis of the 
algorithm with respect to p the Lipschitz condition is assumed to be satisfied uniformly by the 
entire class of games under consideration) . 

Algorithm 4.6. By the Lipschitz assumption there are real numbers Li and L2 such that 

\ui{si,s_i) - Ui{s'i,s^i)\ < Li\si - s-l 

for all S-i G C^i and i = 1,2. Clearly this is equivalent to requiring the same inequality 
for all cr_j G A_j. Divide the interval Ci into equal subintervals of length no more than 
2-^; at most \^~\ such intervals are required. Let Ci be the set of center points of these 

intervals, and construct a finite sampled game by restricting the strategy sets to the Cj. Call 
the resulting payoff matrices Ui and 1/2- Compute a Nash equilibrium of the sampled game. 
To do so, iterate over all pairs of nonempty subsets 5*1 C Ci and 5*2 C C2 such that the 
cardinality of Si is at most + 1 for i = 1, 2. Let xi and X2 be probability vectors indexed 
by the elements of Ci and C2, respectively. For each such pair (^i, S2) we use the fact that 
linear programs are polynomial-time solvable to find xi and X2 such that the following linear 
constraints are satisfied, or prove that no such vectors exist [3]. 

[xiU2]^^ > [xiU2]t^ for all S2 G S2,t2 G C2 
[UiX2]^^ > [UiX2],^ for all Si G Si,ti G Ci 

Xi(si) > for all Sj E Si, i = 1,2 

Xi{si) = for all Sj G Cj \ Si, i = 1,2 

Xi{s,i) = 1 for i = 1, 2 

(There are many redundant constraints here which could easily be removed, but we have 
presented the constraints in this form for simplicity.) Any feasible point for any pair [S\,S2) 
is a Nash equilibrium of the sampled game and an e-equilibrium of the original game. The 
algorithm will find at least one such point. 
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Proof. For the purpose of analyzing the complexity of the algorithm we will view the Lip- 
schitz constants as fixed, even as p varies. Let Ui be the payoffs of the sampled game and 
suppose 0" is a Nash equilibrium of the sampled game. Choose any Si G Ci and let s'^ be an 
element of Ci closest to Sj, so |sj — < ^. Then 



Ui(Si,cr^i - uAcr 



< Ui{si, - Ui{s[, a-i) + Ui{s[, a-i) - Ui{a) 

< \Ui{Si,a^i) - Mj(s-,(T_i)| +Mi(s-,cr_i) -Mi(cr) 

SO a is automatically an e-equilibrium of the original separable game. Thus it will suffice to 
compute a Nash equilibrium of the finite sampled game. 

To do so, first compute or bound the rank p of the original separable game using Theorem 



3.13 or 3.10 By Theorem 3.3 and Corollary 3.5, the sampled game has a Nash equilibrium 



in which player i mixes among at most pj + 1 pure strategies, independent of how large \Ci\ 
is. The separability assumption is fundamental because without it we would not obtain this 
uniform bound independent of \Ci\. The number of possible choices of at most Pi + 1 pure 
strategies from Ci is 

Pi+i 



< (\Ci\+Pi\ _ (\Ci\+p, 



^ V w - V ; \\c^\-l 

which is a polynomial in \Ci\ oc ^ for fixed p and a polynomial in the components of p for 
fixed e. This leaves the step of checking whether there exists an equilibrium a for a given 
choice of Si = supp((Tj) C Ci with l^jl < Pi + I for each i, and if so, computing such an 
equilibrium. Since the game has two players, the set of such equilibria for given supports is 
described by a number of linear equations and inequalities which is polynomial in ^ for fixed p 
and polynomial in the components of p for fixed e; these equations and inequalities are given 
by ([9]). Since linear programs are polynomial-time solvable, we can find a feasible solution 
to such inequalities or prove infeasibility in polynomial time. The two player assumption is 
key at this step, because with more players the constraints would fail to be linear or convex 
and we could no longer use a polynomial time linear programming algorithm. 

Thus we can check all supports and find an e-equilibrium of the sampled game in poly- 
nomial time as claimed. □ 



We will now consider weakening Assumption |4.4[ The Lipschitz condition could be 
weakened to a Holder condition and the same proof would work, but it seems that we must 
require some quantitative bound on the speed of variation of the utilities in order to bound 
the running time of the algorithm. Also, the strategy space could be changed to any compact 
set which can be efficiently sampled, e.g. a box in M". However, for the purpose of asymptotic 
analysis of the algorithm, the proof here only goes through when the Lipschitz constants and 
strategy space are fixed. A more complex analysis would be required if the strategy space 
were allowed to vary with p, for example. 
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It should be noted that the requirement that the strategy space be fixed for asymptotic 



analysis means that Theorem |4.5| does not apply to finite games, at least not if the number 
of strategies is allowed to vary. For the sake of comparison and completeness we state the 
best known e-equilibrium algorithm for finite games below. 

Theorem 4.7 (Lipton et al. [16]). There exists an algorithm to compute an e-equilibrium of 
an m -player finite game with n strategies per player which is polynomial in - for fixed m and 
n, polynomial in m for fixed n and e, and quasipolynomial in n for fixed e and m (assuming 
the payoffs of the games are uniformly hounded). 

In the case of two-player separable games which we have considered, the complexity of 
the payoffs is captured by p, which is bounded by the cardinality of the strategy spaces in 
two-player finite games. Therefore in finite games the complexity of the payoffs and the 
complexity of the strategy spaces are intertwined, whereas in games with infinite strategy 



spaces they are decoupled. The best known algorithm for finite games stated in Theorem 4.7 
has quasipolynomial dependence on the complexity of the game. Our algorithm is interesting 
because it has polynomial dependence on the complexity of the payoffs when the strategy 
spaces are held fixed. In finite games this type of asymptotic analysis is not possible due 
to the coupling between the two notions of complexity of a game, so a direct comparison 
between Theorem 14.51 and Theorem 14.71 cannot be made. 



5 Conclusions 

We have shown that separable games provide a natural setting for the study of games with 
payoffs satisfying a low-rank condition. This level of abstraction allows the low-rank results 
of Lipton et al. pjj to be extended to infinite strategy spaces and multiple players. Since the 
rank of a separable game gives a bound on the cardinality of the supports of equilibria for any 
sampled version of that separable game, approximate equilibria can be computed in time 
polynomial in - by discretizing the strategy spaces and applying standard computational 
techniques for low-rank games. 

Other types of low-rank conditions have been studied for finite games, for example Kan- 
nan and Theobald have considered the condition that the sum of the payoff matrices be 
low-rank [12]. It is likely that that the discretization techniques used here can be applied 
in an analogous way to yield results about computing approximate equilibria of continuous 
games when the sum of the payoffs of the players is a separable function. 

There also exist many computational techniques for finite games which do not make 
low-rank assumptions. It may be possible to extend some of these techniques directly to 
separable games to yield algorithms for computing exact equilibria of separable games. Such 
an extension would likely require an explicit description of the moment spaces in terms of 
inequalities rather than the description given above as the convex hull of the set of moments 
due to pure strategies. In the case of two-player polynomial games, such an explicit de- 
scription is known to be possible using linear matrix inequalities and has been applied to 
zero-sum polynomial games by Parrilo [19]. While the lack of polyhedral structure in the 
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moment spaces would most likely prohibit the use of a Lemke-Howson type algorithm, a 
variety of other finite game algorithms may be extendable to this setting; see McKelvey and 
McLennan for a survey of such algorithms [T7j. 

Finally, there exist a variety of other solution concepts for strategic form games which may 
be amenable to analysis and computation in the case of separable games, and in particular 
in polynomial games. Preliminary results on computation of correlated equilibria appear 
in [231 121] ■ For a correlated equilibrium version of the rank bounds on Nash equilibria of 
separable games presented above, see |23] . We leave the extension to other solution concepts, 
in particular iterated elimination of strictly dominated strategies, for future work. 
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